Image forming apparatus, instruction acceptance method, and computer readable program

ABSTRACT

An image forming apparatus to be used together with equipment to be used by a user with both hands, the image forming apparatus includes: an acceptor that does not accept, by voice, an instruction for processing to be performed by the image forming apparatus before the user holds the equipment but accepts, by the voice, the instruction while the equipment is being used with both of the hands.

The entire disclosure of Japanese patent Application No. 2018-133951,filed on Jul. 17, 2018, is incorporated herein by reference in itsentirety.

BACKGROUND Technological Field

The present invention relates to the technology of an image formingapparatus to be used together with equipment, such as a measurementdevice that measures the living body of a user.

Description of the Related Art

Conventionally, image forming apparatuses referred to as “multi functionperipherals (MFPs)”, have been widespread.

Typically, such an image forming apparatus is instructed by a touch of auser to an input device, such as a touch panel. Furthermore, such animage forming apparatus is instructed by input of a voice of a user intoan input device, such as a microphone. This arrangement enables aninstruction by voice in addition to an instruction by touch, resultingin improvement of the convenience of a user. JP 2013-41379 A, JP2004-234529 A, JP 2013-508808 A, JP 2007-79852 A, and JP 2005-115773 Aeach disclose a device to which a user can provide an instruction bytouch or an instruction by voice.

Mobile electronic equipment described in JP 2013-41379 A includes: acasing; a capacitive touch panel that displays an image and detects atouch operation as an input signal; a microphone that detects a sound asa voice signal; and a controller that processes the voice signaldetected by the microphone as the input signal of the touch operationperformed to the touch panel, in a voice operation mode. Whendiscriminating that the touch operation is abnormal due to moistureadhering to the touch panel or when discriminating that detectedhumidity is a predetermined level or more, the mobile electronicequipment migrates to the voice operation mode.

A kiosk terminal described in JP 2004-234529 A includes: a touch paneldisposed in superimposition on a display, the touch panel being to senseinput by a touch of an operator; and a voice input device that senses avoice of the operator and converts the voice into character data. Whenthe touch panel senses a touch to an input field after display of aninput screen, a Japanese syllabary input screen is displayed. Theoperator touches characters displayed on the Japanese syllabary inputscreen, to input data. In a case where no input has been made throughthe touch panel for five seconds after display of the input screen orafter input through the touch panel, the kiosk terminal accepts voiceinput. That is the kiosk terminal switches to voice input.

A calculation device described in JP 2013-508808 A acquires, in responseto a touch of a user to a touch input area, the positional coordinatesof the touch input area, and further acquires a voice signal from avoice sensor. The impact strength of the touch of the user is determinedon the basis of the voice signal. The calculation device performs anaction associated with the determined impact strength.

According to JP 2007-79852 A, a data processing device in a voice inputmode in which processing is performed on the basis of a voice inputthrough a microphone, migrates, in a case where determining that aninput voice has been registered in a voice-input prohibition informationlist, to an operator input mode to prompt a user to perform an inputwith a numeric keypad, otherwise prompts the user to perform an inputwith a voice. Thus, for information requiring retaining as a secret, thedata processing device prompts the user to perform an input with thenumeric keypad in order to prevent another person from listening to theinformation, and, for information requiring no retaining as a secret,prompts the user to perform a simplified input through a voice.

An L mode facsimile described in JP 2005-115773 A includes: a voicerecognizer; a button operator; an operation time database; a CPU; a RAM;a ROM; a display; and a voice synthesizer. On the basis of a taskselection of a user, the CPU reads the average operation time in eachinput mode (a voice input mode, a button input mode, or the voice inputmode and the button input mode) from the operation time database, anddisplays an input mode selection screen on the display. Selection of acombined operation of voice input and button input by the user on theinput mode selection screen, causes the CPU to display a screenprompting the user to perform voice input. Then, the CPU displays aresult of utterance of the user recognized in voice by the voicerecognizer, onto the screen. Next, the CPU displays a screen promptingthe user to perform button input, and displays a result of the buttoninput of the user onto the screen.

However, even when a function of accepting an instruction by voice isprovided, only provision of an instruction by touch from a user makesthe function unused. There is a possibility that acceptance of a voiceof a user who is not using an image forming apparatus, as aninstruction, causes the image forming apparatus to perform unnecessaryprocessing.

SUMMARY

An object of the present invention is to provide an image formingapparatus in which a function of accepting an instruction by voice ismore efficient than ever before.

To achieve the abovementioned object, according to an aspect of thepresent invention, there is provided an image forming apparatus to beused together with equipment to be used by a user with both hands, andthe image forming apparatus reflecting one aspect of the presentinvention comprises: an acceptor that does not accept, by voice, aninstruction for processing to be performed by the image formingapparatus before the user holds the equipment but accepts, by the voice,the instruction while the equipment is being used with both of thehands.

BRIEF DESCRIPTION OF THE DRAWINGS

The advantages and features provided by one or more embodiments of theinvention will become more fully understood from the detaileddescription given hereinbelow and the appended drawings which are givenby way of illustration only, and thus are not intended as a definitionof the limits of the present invention:

FIG. 1 is an illustration of an exemplary external appearance of animage forming apparatus;

FIG. 2 is an illustration of the hardware configuration of the imageforming apparatus;

FIG. 3 is an illustration of an exemplary measurement device held withboth hands of a user;

FIG. 4 is an illustration of an exemplary functional configuration ofthe image forming apparatus;

FIG. 5 is an illustration of an exemplary home screen;

FIG. 6 is an illustration of an exemplary copy operation screen;

FIG. 7 is an illustration of exemplary job data;

FIG. 8 is an illustration of an exemplary explanatory screen;

FIG. 9 is an illustration of exemplary personal data;

FIG. 10 is an illustration of an exemplary measurement-in-processscreen;

FIG. 11 is an illustration of an exemplary measured-result screen;

FIG. 12 is an illustration of an exemplary view screen;

FIG. 13 is a flowchart of an exemplary flow of entire processing of theimage forming apparatus;

FIG. 14 is a flowchart of an exemplary flow ofmeasurement-start-occasion processing;

FIG. 15 is a flowchart of an exemplary flow of voice-input-basedprocessing; and

FIG. 16 is a flowchart of an exemplary flow of view screen processing.

DETAILED DESCRIPTION OF EMBODIMENTS

Hereinafter, one or more embodiments of the present invention will bedescribed with reference to the drawings. However, the scope of theinvention is not limited to the disclosed embodiments.

FIG. 1 is an illustration of an exemplary external appearance of animage forming apparatus 1. FIG. 2 is an illustration of the hardwareconfiguration of the image forming apparatus 1. FIG. 3 is anillustration of an exemplary measurement device 10 r held with bothhands of a user. FIG. 4 is an illustration of an exemplary functionalconfiguration of the image forming apparatus 1.

The image forming apparatus 1 illustrated in FIG. 1 has a collectivefunction, such as copying, PC printing, cloud printing, faxing,scanning, and boxing. Generally, the image forming apparatus 1 is alsoreferred to as a “multi function peripheral (MFP)”.

The PC print function allows printing an image on a sheet on the basisof image data received from a terminal device in the same local areanetwork (LAN) as the image forming apparatus 1. The PC print function isalso referred to as “network printing” or “network print”.

The cloud print function allows printing an image on a sheet on thebasis of image data received from an external terminal device through aserver on the Internet.

The box function allows each user given a storage area referred to as a“box” or a “personal box”, to save and manage, for example, image datain the storage area. Provision of a box per group enables the members toshare in each group. The box corresponds to a “folder” or a “directory”in a personal computer.

As illustrated in FIG. 2, the image forming apparatus 1 includes, forexample, a central processing unit (CPU) 10 a, a random access memory(RAM) 10 b, a read only memory (ROM) 10 c, an auxiliary storage device10 d, a touch panel display 10 e, an operation key panel 10 f, a networkinterface card (NIC) 10 g, a wireless LAN communication unit 10 h, amodem 10 i, a scan unit 10 j, a print unit 10 k, a finisher 10 m, avoice input unit 10 n, and a measurement device 10 r.

The CPU 10 a is the main CPU of the image forming apparatus 1. The RAM10 b is the main memory of the image forming apparatus 1.

The touch panel display 10 e displays, for example, a screen indicatinga message to the user, a screen into which the user inputs a command orinformation, or a screen indicating a result of processing performed bythe CPU 10 a. Furthermore, the touch panel display 10 e transmits asignal indicating the touched position, to the CPU 10 a.

The operation key panel 10 f that is a so-called hardware keyboard,includes, for example, a numeric keypad, a start key, a stop key, andfunction keys.

The NIC 10 g communicates with a different device in accordance with aprotocol, such as transmission control protocol/internet protocol(TCP/IP).

The wireless LAN communication unit 10 h communicates with a differentdevice on the basis of the standard of Institute of Electrical andElectronics Engineers (IEEE) 802.11 that is a wireless LAN standard.

The modem 10 i exchanges document data with a facsimile in accordancewith a protocol, such as G3.

The scan unit 10 j reads an image on an original (sheet) set on an autodocument feeder (ADF) or a platen glass, and generates image data.

The print unit 10 k prints an image in image data received from anexternal device through the NIC 10 g, onto a sheet, in addition to theimage read by the scan unit 10 j.

The finisher 10 m performs, as necessary, postprocessing to printedmatter acquired by the print unit 10 k. Examples of the postprocessinginclude processing of stapling, processing of punching, and processingof folding.

The voice input unit 10 n including, for example, a sound board and amicrophone, collects sound and generates voice data 6A. Particularly, ina case where the user instructs the image forming apparatus 1 byso-called voice input, the voice input unit 10 n generates the voicedata 6A indicating a voice uttered from the user (namely, a voice of theuser).

The measurement device 10 r measures, for example, the blood pressureand the pulse of the user. As illustrated in FIG. 3, the user coversfour terminals with the thumbs and the forefingers of both hands. Inthis manner, the measurement device 10 r is held with both hands.

For example, the measurement device 10 r irradiates the thumbs and theforefingers of both hands with light, and detects the light reflectedfrom the fingers at predetermined time intervals (e.g., every onesecond). This arrangement allows acquisition of a pulse wave. While themeasurement device 10 r itself is being held, for example, the bloodpressure and the pulse of the user are measured on the basis of theacquired pulse wave. The measurement device 10 r generates measurementdata 6B indicating a measured result (namely, measured values) and thentransmits the measurement data 6B to the image forming apparatus 1.

The measurement device 10 r is connected to the image forming apparatus1 by wire or wireless. The measurement device 10 r is disposeddetachably, for example, on a side face of the image forming apparatus1. Note that removal of the measurement device 10 r from the side facecauses a sensor to detect the removal.

The ROM 10 c or the auxiliary storage device 10 d stores an applicationfor achieving a function, such as the copying. The ROM 10 c or theauxiliary storage device 10 d stores a measurement-occasion processingprogram 10P (refer to FIG. 4).

The measurement-occasion processing program 10P enables the imageforming apparatus 1 to accept an instruction by voice input of the userwhile the measurement device 10 r is measuring the blood pressure of theuser. The measurement-occasion processing program 10P allows output ofthe measured result. The detail thereof will be described later.

The measurement-occasion processing program 10P causes a login processor101, a voice input OFF setter 102, a screen display unit 103, a jobexecutor 104, a job data storage 105, an explanatory necessitydiscriminator 106, a personal data storage 107, a voice input ON setter108, a measurement-occasion processor 109, and a voice processor 110 ofFIG. 4 to be achieved in the image forming apparatus 1.

FIG. 5 is an illustration of an exemplary home screen 5A. FIG. 6 is anillustration of an exemplary copy operation screen 51B. FIG. 7 is anillustration of exemplary job data 6C. FIG. 8 is an illustration of anexemplary explanatory screen 5C. FIG. 9 is an illustration of exemplarypersonal data 6D. FIG. 10 is an illustration of an exemplarymeasurement-in-process screen 51D. FIG. 11 is an illustration of anexemplary measured-result screen 52D. FIG. 12 is an illustration of anexemplary view screen 5F.

The operation of the login processor 101, the voice input OFF setter102, the screen display unit 103, the job executor 104, the job datastorage 105, the explanatory necessity discriminator 106, the personaldata storage 107, the voice input ON setter 108, themeasurement-occasion processor 109, and the voice processor 110 of FIG.4, will be described below with reference to FIGS. 5 to 12 with anexemplary case where the image forming apparatus 1 performs a job ofcopying and receives the measurement data 6B from the measurement device10 r.

The user considers causing the image forming apparatus 1 to copy theimage of an original. Then, the user with the user name and the passwordthereof makes a request to the image forming apparatus 1 for login.Then, the following processing is performed.

In response to acceptance of the request for login, the login processor101 of the image forming apparatus 1 discriminates whether the user isan authorized user, and permits the user to log in the image formingapparatus 1 in a case where the user is an authorized user.

After permission for login, the voice input OFF setter 102 makes, whenthe function of the voice input unit 10 n is active (namely, on), thefunction inactive (namely, off) in order to prevent voice input frombeing performed.

Every occurrence of an event, the screen display unit 103 appropriatelycauses the touch panel display 10 e to display a screen corresponding tothe event, as to be described sequentially later.

After permission for login, the screen display unit 103 causes the touchpanel display 10 e to display the home screen 5A as in FIG. 5. The homescreen 5A allows the user to select an operation screen 5B to bedisplayed on the touch panel display 10 e, from a plurality of operationscreens 5B, the operation screen 5B being to be operated by the user inorder to cause the image forming apparatus 1 to perform the job. Aplurality of icons each having a job name is disposed on the home screen5A.

The user presses an icon 7A corresponding to a screen to be operated forperformance of the job of copying, from the plurality of icons, toprovide the image forming apparatus 1 with an instruction for display ofthe copy operation screen 51B as in FIG. 6 onto the touch panel display10 e.

Then, the screen display unit 103 causes the touch panel display 10 e todisplay the copy operation screen 51B.

After providing the instruction for display of the copy operation screen51B onto the touch panel display 10 e, the user sets the original to theADF. Input of conditions for the job of copying (e.g., the number ofprint copies and scaling) sets the job, and then an instruction forstart of the job is provided. Then, the job executor 104 performs thefollowing processing.

The job executor 104 controls each constituent of the image formingapparatus 1 such that the job is performed. Here, because of the job ofcopying, the job executor 104 causes, for example, the scan unit 10 jand the print unit 10 k to perform the job.

Furthermore, the job executor 104 generates the job data 6C indicatingthe job code identifying the job, the job type indicating the type ofthe job, and the user code of the user who has provided the instruction,and stores the job data 6C into the job data storage 105 every job codeas in FIG. 7.

Note that the image of the original read by the scan unit 10 j is storedin, for example, the RAM 10 b.

After causing the image forming apparatus 1 to start the job of copying,the user is on standby in front of the image forming apparatus 1 duringperformance of the job. Here, the user considers measuring the bloodpressure of the user itself during the standby time. Then, the userdetaches the measurement device 10 r from the side face of the imageforming apparatus 1. Then, the following processing is performed.

When the sensor detects that the measurement device 10 r has beendetached from the side face of the image forming apparatus 1, theexplanatory necessity discriminator 106 discriminates whether theexplanatory screen 5C as in FIG. 8 is to be displayed on the touch paneldisplay 10 e, on the basis of the personal data 6D stored in thepersonal data storage 107, as below. The explanatory screen 5C providesthe user with the description of the method of operating the imageforming apparatus 1 by voice. Note that the explanatory screen 5C mayprovide the description of the measurement method with the measurementdevice 10 r.

The personal data storage 107 stores the personal data 6D including themeasurement date and time indicating the date and time of measurement ofthe blood pressure of the user in the past with the image formingapparatus 1, the subject code of the user (namely, a subject), and themeasurement data 6B of the user, every measurement date and time, as inFIG. 9.

Note that processing of generating the personal data 6D and storing thepersonal data 6D into the personal data storage 107, will be describedlater.

The explanatory necessity discriminator 106 searches the personal datastorage 107 for the personal data 6D having the subject code identicalto the user code of the user who is currently logging in the imageforming apparatus 1. In a case where the personal data 6D has not beenfound or in a case where the personal data 6D less in pieces of datathan a predetermined number has been found, the explanatory necessitydiscriminator 106 discriminates that the explanatory screen 5C is to bedisplayed. In a case where the personal data 6D not less in pieces ofdata than the predetermined number has been found, the explanatorynecessity discriminator 106 discriminates that the explanatory screen 5Cis not to be displayed. The predetermined number can be arbitrarily setby an administrator.

That is, in a case where the image forming apparatus 1 cannot find thepersonal data 6D for the user who intends to measure blood pressure fromnow, not less in pieces of data than the predetermined number, the imageforming apparatus 1 discriminates that the user is an inexperiencedperson in operating the image forming apparatus 1 while measuring bloodpressure, namely, a beginner. Then, the image forming apparatus 1indicates the method of operating the image forming apparatus 1 itselfwith the measurement device 10 r held with both hands (namely, byvoice), to the user.

For example, in a case where the predetermined number is three or more,the user code of the user who is currently logging in the image formingapparatus 1 is “U004”, and the personal data storage 107 stores thepersonal data 6D as in FIG. 9, the explanatory necessity discriminator106 discriminates that the explanatory screen 5C is to be displayed.

When the explanatory necessity discriminator 106 discriminates that theexplanatory screen 5C is to be displayed, the screen display unit 103causes the touch panel display 10 e to display the explanatory screen5C.

After appropriately verifying the method of operating the image formingapparatus 1 through the explanatory screen 5C, the user presses an “end”icon 7C on the explanatory screen 5C. Then, the following processing isperformed.

When the user presses the “end” icon 7C on the explanatory screen 5C,the voice input ON setter 108 (refer to FIG. 4) turns on the function ofthe voice input unit 10 n. That is the voice input ON setter 108 makesthe function active such that voice input is allowed. Similarly, whenthe explanatory necessity discriminator 106 discriminates that theexplanatory screen 5C is not to be displayed, the voice input ON setter108 turns on the function of the voice input unit 10 n.

When the user presses the “end” icon 7C on the explanatory screen 5C,the measurement device 10 r starts processing of measurement. Similarly,when the explanatory necessity discriminator 106 discriminates that theexplanatory screen 5C is not to be displayed, the measurement device 10r starts the processing of measurement.

Here, for example, the measurement device 10 r cannot acquire the pulsewave of the user unless the user holds the measurement device 10 rcorrectly. As a result, the processing of measurement is not allowed tostart. In this case, the screen display unit 103 may cause the touchpanel display 10 e to continuously display a screen displaying an error,until the measurement device 10 r is allowed to start the processing ofmeasurement.

The measurement device 10 r generates the measurement data 6B everymeasurement, and transmits the measurement data 6B to the image formingapparatus 1, successively.

After reception of the first measurement data 6B (hereinafter, referredto as “measurement data 61B”) in the processing of measurement for thistime (hereinafter, referred to as “measurement processing for thistime”), the measurement-occasion processor 109 performs the followingprocessing.

After reception of the measurement data 61B, the measurement-occasionprocessor 109 causes the personal data storage 107 to store, as thepersonal data 6D, the measurement data 61B in association with the dataand time of the reception of the measurement data 61B as the measurementdate and time and the user code of the user who is currently logging inthe image forming apparatus 1 as the subject code (refer to FIG. 9). Inaddition, the measurement-occasion processor 109 starts measurement ofelapse in time.

After reception of the measurement data 61B, the measurement-occasionprocessor 109 causes the personal data storage 107 to store, everyreception of the measurement data 6B in the measurement processing forthis time, the measurement data 6B. In this case, the storing isperformed such that the data already stored in the personal data storage107 is not overwritten.

Note that, in a case where the elapsed time is more than the requiredtime from the start to the completion of the processing of measurement,previously stored, for example, in the auxiliary storage device 10 d,the measurement-occasion processor 109 discriminates that themeasurement processing for this time has been completed.

After the measurement device 10 r starts the processing of measurement,the screen display unit 103 performs processing of generating themeasurement-in-process screen 51D indicating the content of measurementstill in progress as in FIG. 10, as below.

That is the screen display unit 103 reads the personal data 6D of themeasurement processing for this time, from the pieces of personal data6D stored in the personal data storage 107.

The screen display unit 103 requests the remaining time t untilcompletion of the measurement processing for this time, from themeasurement-occasion processor 109. In response to the request, themeasurement-occasion processor 109 calculates the difference between therequired time and the elapsed time as the remaining time t, andtransmits the remaining time t to the screen display unit 103.

The screen display unit 103 generates the measurement-in-process screen51D, on the basis of the measurement data 6B of the read personal data6D and the received remaining time t.

Note that the screen display unit 103 may reread the personal data 6Dand request and receive the new remaining time t at predetermined timeintervals (e.g., every two or three seconds) to generate the newmeasurement-in-process screen 51D to be displayed on the touch paneldisplay 10 e. This arrangement causes the measurement-in-process screen51D to be updated at the predetermined time intervals.

The screen display unit 103 causes the touch panel display 10 e todisplay the generated measurement-in-process screen 51D.

When the measurement-occasion processor 109 discriminates that themeasurement processing for this time has been completed, the screendisplay unit 103 generates the measured-result screen 52D indicating ameasured result as in FIG. 11, on the basis of all the measurement data6B of the personal data 6D of the measurement processing for this time,and causes the touch panel display 10 e to display the measured-resultscreen 52D.

After verifying the measured result through the measured-result screen52D, the user provides, by voice, the image forming apparatus 1 with aninstruction for display of the home screen 5A onto the touch paneldisplay 10 e. Alternatively, before completion of the measurementprocessing for this time, the user provides, by voice, the image formingapparatus 1 with an instruction for interruption of the measurementprocessing for this time (namely, cancellation). Then, the followingprocessing is performed.

Every input of a voice from the user, the voice input unit 10 n (referto FIG. 2) generates the voice data 6A, on the basis of the voice of theuser.

The voice processor 110 (refer to FIG. 4) acquires the voice data 6Agenerated by the voice input unit 10 n, and converts the voice data 6Ainto a character code, for example, with an input method editor (IME)for sound. The voice processor 110 identifies the content of theinstruction from the user, on the basis of the character code. That is,the occurred event is identified.

Provision of the instruction for display of the home screen 5A while themeasured-result screen 52D is being displayed on the touch panel display10 e or provision of the instruction for interruption of the measurementprocessing for this time, causes the voice input OFF setter 102 to turnoff the function of the voice input unit 10 n. The screen display unit103 causes the touch panel display 10 e to display the home screen 5A(refer to FIG. 5). Note that the image of the original stored in the RAM10 b is deleted.

The provision of the instruction for interruption of the measurementprocessing for this time, causes the measurement device 10 r tointerrupt the processing of measurement.

Note that, while the measurement-in-process screen 51D is beingdisplayed, the user can provide, by voice, an instruction for redisplayof the operation screen 5B displayed on the touch panel display 10 ebefore removal of the measurement device 10 r from the side face of theimage forming apparatus 1. Due to provision of the instruction, thescreen display unit 103 causes the touch panel display 10 e to displaythe operation screen 5B.

After that, the user provides, by voice, the image forming apparatus 1with an instruction for redisplay of the measurement-in-process screen51D onto the touch panel display 10 e. Then, similarly to the above, thescreen display unit 103 reads the personal data 6D and requests andreceives the new remaining time t, generates the measurement-in-processscreen 51D, on the basis of the read personal data 6D and the receivedremaining time t, and then causes the touch panel display 10 e todisplay the measurement-in-process screen 51D.

Here, when the function of the voice input unit 10 n is on, the userprovides, by voice, the image forming apparatus 1 with an instructionfor interruption (namely, cancellation) or suspension of the jobcurrently being performed by the image forming apparatus 1. Then, thejob executor 104 controls each constituent of the image formingapparatus 1 such that the job is suspended, for example.

In this case, the job executor 104 discriminates whether the user whohas provided the instruction for performance of the job, is identical tothe user who has provided the instruction for interruption or suspensionof the job. Specifically, the job executor 104 makes discrimination, onthe basis of the user code for the job currently being performed and thesubject code of the personal data 6D of the measurement processing forthis time. Then, in a case where both of the users are identical, eachconstituent of the image forming apparatus 1 is controlled so as tosuspend the job.

Alternatively, when the function of the voice input unit 10 n is on, theuser provides, by voice, an instruction for redisplay of the explanatoryscreen 5C onto the touch panel display 10 e, so that the screen displayunit 103 causes the touch panel display 10 e to display the explanatoryscreen 5C.

Alternatively, when the function of the voice input unit 10 n is on, theuser provides, by voice, an instruction for display of a list of jobsperformed or being performed by the image forming apparatus 1. Then, onthe basis of the job data 6C stored in the job data storage 105, thescreen display unit 103 causes the touch panel display 10 e to display ajob list screen 5E indicating a list of jobs performed or beingperformed by the image forming apparatus 1.

Alternatively, when the function of the voice input unit 10 n is on, theuser provides, by voice, the image forming apparatus 1 with aninstruction for verification of an image in the job of printingcurrently being performed by the image forming apparatus 1 (hereinafter,referred to as a “print image 7F”). Then, the screen display unit 103causes the touch panel display 10 e to display the view screen 5F as inFIG. 12 for verification of the print image 7F.

In a case where a plurality of originals is included in the job ofprinting, while the view screen 5F is being displayed on the touch paneldisplay 10 e, the user provides, by voice, the image forming apparatus 1with an instruction for change of a print image 71F that is the printimage 7F currently being displayed on the view screen 5F, to the imageof the next original of the original of the print image 71F (namely, thenext print image 7F). Alternatively, the user provides an instructionfor change to the image of the previous original of the original of theprint image 71F (namely, the previous print image 7F). Then, the screendisplay unit 103 causes the touch panel display 10 e to display the viewscreen 5F including the print image 7F changed in accordance with theinstruction of the user.

While the view screen 5F is being displayed on the touch panel display10 e, the user considers changing the direction of printing of the printimage 7F because the direction of typing is not identical to theorientation of a sheet. Then, the user provides, by voice, the imageforming apparatus 1 with an instruction for suspension of the job ofprinting currently being performed by the image forming apparatus 1.

Similarly to the above, the job executor 104 controls each constituentof the image forming apparatus 1 such that the job of printing issuspended.

Subsequently, the user provides, by voice, the image forming apparatus 1with an instruction for rotation of the print image 7F by apredetermined angle in a predetermined direction (e.g., by 90°clockwise). That is the user provides, by voice, the image formingapparatus 1 with an instruction for change of the direction of printingof the print image 7F. Then, the screen display unit 103 causes thetouch panel display 10 e to display the view screen 5F including theprint image 7F rotated in accordance with the instruction of the user.

Subsequently, the user provides, by voice, the image forming apparatus 1with an instruction for determination of the degree of rotation of theprint image 7F (namely, the degree of change of the direction ofprinting). Then, the job executor 104 controls each constituent of theimage forming apparatus 1 such that the job of printing is performed tothe rotated print image 7F from the beginning.

While the view screen 5F is being displayed on the touch panel display10 e, the user provides an instruction for adjustment of the print image7F, for example, in density. Then, the screen display unit 103 causesthe touch panel display 10 e to display the view screen 5F including theprint image 7F adjusted in density in accordance with the instruction ofthe user.

Alternatively, when the function of the voice input unit 10 n is on, theuser provides an instruction for performance of a job of reprinting animage in the job of printing recently performed by the image formingapparatus 1 (hereinafter, referred to as a “reprint job”). Then, the jobexecutor 104 searches the RAM 10 b for the image that is the target ofthe reprint job, and causes the reprint job to be performed to a foundimage.

Note that, unless the image forming apparatus 1 has started the job whenthe function of the voice input unit 10 n is on, the user can provide,by voice, an instruction for start of the job.

In this case, the job executor 104 discriminates whether preparation forperformance of the job has been completed, on the basis of, for example,whether the original has been set to the ADF. Then, in a case where thepreparation has been completed, the job executor 104 controls eachconstituent of the image forming apparatus 1 such that the job isperformed.

FIG. 13 is a flowchart of an exemplary flow of entire processing of theimage forming apparatus 1. FIG. 14 is a flowchart of an exemplary flowof measurement-start-occasion processing. FIG. 15 is a flowchart of anexemplary flow of voice-input-based processing. FIG. 16 is a flowchartof an exemplary flow of view screen processing.

Next, the flow of entire processing in the image forming apparatus 1will be described with reference to the flowcharts of FIGS. 13 to 16.

The image forming apparatus 1 performs the processing in the orderillustrated in FIG. 13, on the basis of the measurement-occasionprocessing program 10P.

The image forming apparatus 1 performs login processing in response to arequest for login from the user (#601 of FIG. 13), switches off thefunction of voice input, if the function of voice input is on, afterpermission for login (#602), and displays the home screen 5A (#603).

In a case where the user has selected the operation screen 5B that theuser desires to display (Yes at #604), the image forming apparatus 1displays the selected operation screen 5B (#605).

In a case where the user has input conditions for the job (Yes at #606),the image forming apparatus 1 sets the job in accordance with theconditions (#607).

In a case where the user has provided an instruction for start of thejob (Yes at #608), the image forming apparatus 1 starts the job (#609).In this case, an image acquired while the job is being performed (e.g.,the image of the original read by the scan unit 10 j), is stored in theRAM 10 b.

In a case where detecting that the measurement device 10 r has beendetached (Yes at #610 and No at #611), the image forming apparatus 1performs the measurement-start-occasion processing as in FIG. 14 (#612).

In the measurement-start-occasion processing, the image formingapparatus 1 discriminates whether the user who intends to measure bloodpressure is a beginner (#631).

In a case where discriminating that the user is a beginner (Yes at#632), the image forming apparatus 1 displays the explanatory screen 5C(#633). In a case where discriminating that the user is not a beginner(No at #632) or in a case where the explanatory screen 5C is closed (Yesat #634), the image forming apparatus 1 starts the measurementprocessing (#635), displays the measurement-in-process screen 51D(#636), and turns on the function of voice input (#637).

While the measurement device 10 r is continuously generating themeasurement data 6B, namely, while the measurement device 10 r isperforming the measurement processing for this time (Yes at #610, Yes at#611, No at #613, and No at #618), when the user performs voice input(Yes at #614), the image forming apparatus 1 performs thevoice-input-based processing as in FIG. 15 (#615).

In the voice-input-based processing, in a case where the voice inputincludes an instruction for start of the job (Yes at #651) and in a casewhere preparation for performance of the job has been completed (Yes at#652), the image forming apparatus 1 starts the job and stores an imagein the job into, for example, the RAM 10 b (#653).

In a case where the voice input includes an instruction for interruptionor suspension of the job (Yes at #654), the image forming apparatus 1discriminates whether the user who has provided the instruction forperformance of the job and the subject are identical (#655). In a casewhere the user and the subject are identical (Yes at #656), the imageforming apparatus 1 suspends the job (#657).

In a case where the voice input includes an instruction for display ofthe explanatory screen 5C (Yes at #658), the image forming apparatus 1displays the explanatory screen 5C (#659).

In a case where the voice input includes an instruction for display ofthe measurement-in-process screen 51D (Yes at #660), the image formingapparatus 1 displays the measurement-in-process screen 51D (#661).

In a case where the voice input includes an instruction for display ofthe job list screen 5E (Yes at #662), the image forming apparatus 1displays the job list screen 5E (#663).

In a case where the voice input includes an instruction for display ofthe view screen 5F (Yes at #664), the image forming apparatus 1 displaysthe view screen 5F (#665). While the view screen 5F is being displayed(Yes at #666), the image forming apparatus 1 performs the view screenprocessing as in FIG. 16 (#667).

In the view screen processing, in a case where the user has provided, byvoice, an instruction for change of the print image 7F on the viewscreen 5F (namely, the print image 71F) to the next print image 7F (Yesat #681), the image forming apparatus 1 displays the view screen 5Fincluding the next print image 7F (#682).

In a case where the user has provided, by voice, an instruction forchange of the print image 7F on the view screen 5F (namely, the printimage 71F) to the previous print image 7F (Yes at #683), the imageforming apparatus 1 displays the view screen 5F including the previousprint image 7F (#684).

In a case where the user has provided, by voice, an instruction forsuspension of the job of printing of the print image 7F and rotation ofthe print image 7F (Yes at #685), the image forming apparatus 1 suspendsthe job of printing (#686), and then displays the view screen 5Fincluding the print image 7F rotated by a specified angle and performsthe job of printing from the beginning (#687).

In a case where the user has provided, by voice, an instruction foradjustment of the print image 7F (Yes at #688), the image formingapparatus 1 displays the view screen 5F including the print image 7Fadjusted in accordance with the instruction (#689).

Referring back to FIG. 15, in a case where the user has provided, byvoice, an instruction for performance of the reprint job (Yes at #668),the image forming apparatus 1 performs the reprint job (#669).

Referring back to FIG. 13, in a case where the measurement processingfor this time has been completed (Yes at #613), the image formingapparatus 1 displays the measured-result screen 52D (#616), and deletesthe image in the job stored in the RAM 10 b (#617). Then, the imageforming apparatus 1 turns off the function of voice input (#602).

In a case where the user has provided an instruction for interruption ofthe measurement processing for this time (Yes at #618), the imageforming apparatus 1 interrupts the measurement processing for this timeand deletes the image in the job stored in the RAM 10 b (#619). Notethat, in this case, the effect that the measurement processing for thistime has been interrupted, may be displayed on the touch panel display10 e. Then, the image forming apparatus 1 turns off the function ofvoice input (#602).

Until the image forming apparatus 1 performs logout processing inresponse to a request for logout from the user (Yes at #620), the imageforming apparatus 1 appropriately repeats steps #602 to #619, #631 to#637, #651 to #669, and #681 to #689 described above.

According to the present embodiment, the image forming apparatus 1 canbe provided in which the function of accepting an instruction by voiceis more efficient than ever before.

According to the present embodiment, the timing the voice input ONsetter 108 turns on the function of the voice input unit 10 n, is whenthe user presses the “end” icon 7C on the explanatory screen 5C.However, the timing may be any of the following timings.

That is the timing may be when the measurement device 10 r acquires thepulse wave of the user (namely, when the processing of measurementstarts). Alternatively, the timing may be when the explanatory necessitydiscriminator 106 discriminates whether the explanatory screen 5C is tobe displayed on the touch panel display 10 e. Alternatively, the timingmay be when the sensor detects that the measurement device 10 r has beendetached from the side face of the image forming apparatus 1.

According to the present embodiment, the timing the voice input OFFsetter 102 turns off the function of the voice input unit 10 n is whenan instruction is provided for display of the home screen 5A while themeasured-result screen 52D is being displayed on the touch panel display10 e or when an instruction is provided for interruption of themeasurement processing for this time, after permission for login of thelogin processor 101. However, the timing may be any of the followingtimings.

That is the timing may be when the measurement device 10 r finishestransmitting all the measurement data 6B (namely, when completing theprocessing of measurement). Alternatively, the timing may be when thesensor detects that the measurement device 10 r has returned to theoriginal position (namely, to the side face of the image formingapparatus 1). Alternatively, the timing may be when the measurementdevice 10 r is disabled from acquiring the pulse wave of the user whilethe processing of measurement is being performed.

According to the present embodiment, the condition that the explanatorynecessity discriminator 106 discriminates that the explanatory screen 5Cis to be displayed, meets that the personal data 6D of the subject codeidentical to the user code of the user who is currently logging in theimage forming apparatus 1 (hereinafter, referred to as “identicaldata”), not less in pieces of data than the predetermined number, isstored in the personal data storage 107.

However, the condition (namely, the condition of discriminating that theexplanatory screen 5C is to be displayed) may meet that the interval isa predetermined time or more (e.g., 500 hours or more) between themeasurement date and time of the identical data recently stored in thepersonal data storage 107 and the time of start of the processing ofmeasurement by the user who is currently logging in (e.g., the time ofdetachment of the measurement device 10 r from the image formingapparatus 1) (hereinafter, referred to as a “measurement intervaltime”).

Furthermore, the explanatory necessity discriminator 106 maydiscriminate that the explanatory screen 5C is to be displayed, as longas the measurement interval time is the predetermined time or more evenwhen the identical data not less in pieces of data than thepredetermined number, is stored in the personal data storage 107.

According to the present embodiment, the condition that the measurementdevice 10 r starts the processing of measurement, meets that the userpresses the “end” icon 7C on the explanatory screen 5C or that theexplanatory necessity discriminator 106 discriminates that theexplanatory screen 5C is not to be displayed.

However, the condition (namely, the condition of starting the processingof measurement) may meet that the user provides, by voice, the imageforming apparatus 1 with an instruction for start of the processing ofmeasurement after the user presses the “end” icon 7C on the explanatoryscreen 5C or after the explanatory necessity discriminator 106discriminates that the explanatory screen 5C is not to be displayed.

According to the present embodiment, the measurement-occasion processor109 calculates the remaining time t. However, the measurement device 10r may calculate the remaining time t. According to the embodiment, thecondition that the measurement-occasion processor 109 discriminates thatthe processing of measurement has been completed, meets that the elapsedtime measured by the measurement-occasion processor 109 is more than therequired time. However, the condition may meet that the measurementdevice 10 r notifies the measurement-occasion processor 109 that theprocessing of measurement has been completed and then themeasurement-occasion processor 109 receives the notification.

For each case, the measurement device 10 r stores the required time. Themeasurement device 10 r starts the processing of measurementsimultaneously with measurement of elapse in time. Every generation ofthe measurement data 6B, the remaining time t is calculated on the basisof the elapsed time and the required time. The calculated remaining timet together with the measurement data 6B is transmitted to themeasurement-occasion processor 109.

When the elapsed time exceeds the required time, the measurement device10 r completes the processing of measurement. The measurement device 10r notifies the measurement-occasion processor 109 that the processing ofmeasurement has been completed, simultaneously with transmission of thelast generated measurement data 6B. The measurement-occasion processor109 discriminates that the processing of measurement has been completed,on the basis of reception of the last generated measurement data 6B andreception of the notification that the processing of measurement hasbeen completed.

According to the present embodiment, when the print image 7F on the viewscreen 5F is changed as described above (namely, changed to the image ofthe next original or the image of the previous original) or is adjusted,the job executor 104 may cause suspension of the job being performed, inaccordance with an instruction from the user.

In this case, the job executor 104 may discriminate whether the user whohas provided the instruction for performance of the job is identical tothe user who has provided the instruction for change of the print image7F. Then, in a case where both of the users are identical, as describedabove, the job executor 104 is required at least to control eachconstituent of the image forming apparatus 1 such that the job issuspended. After that, the screen display unit 103 is required at leastto cause the touch panel display 10 e to display the view screen 5Fincluding the print image 7F changed in accordance with the instructionof the user.

In addition, for example, the entire configuration of the image formingapparatus 1, the configuration of each constituent of the image formingapparatus 1, the content of processing, the order of processing, and theconfiguration of data can be appropriately changed without departingfrom the spirit of the present invention.

Although embodiments of the present invention have been described andillustrated in detail, the disclosed embodiments are made for purposesof illustration and example only and not limitation. The scope of thepresent invention should be interpreted by terms of the appended claims.

What is claimed is:
 1. An image forming apparatus to be used togetherwith equipment to be used by a user with both hands, the image formingapparatus comprising: a voice input unit configured to collect sound andgenerate voice data; a hardware processor configured to turn on and offvoice input processing; wherein the image forming apparatus does notaccept, by voice, an instruction for processing to be performed by theimage forming apparatus before the user holds the equipment and theimage processing apparatus turns on the voice input processing inresponse to the equipment being used with both of the hands.
 2. Theimage forming apparatus according to claim 1, wherein the hardwareprocessor is further configured to: receive, from the equipment,information regarding a living body of the user acquired by theequipment while the equipment is being used with both of the hands; andoutput the information received.
 3. The image forming apparatusaccording to claim 1, wherein, while the image forming apparatus isperforming a job given from the user as the processing, with theequipment used with both of the hands, the hardware processor accepts,by the voice, a first instruction for interruption or suspension of thejob as the instruction.
 4. The image forming apparatus according toclaim 3, wherein the job includes a print job in which the image formingapparatus prints an image, and while the image forming apparatus isperforming the print job as the processing, with the equipment used withboth of the hands, the hardware processor accepts, by the voice, asecond instruction for suspension of the print job as the instructionwhile the image is being displayed, and then accepts, by the voice, athird instruction for rotation of the image as the instruction.
 5. Theimage forming apparatus according to claim 4, wherein, while theequipment is being used with both of the hands, the hardware processoraccepts, by the voice, as the instruction, a fourth instruction forstart of a reprint job of printing the image printed or interrupted inprinting by the image forming apparatus in the print job, as theprocessing newly.
 6. The image forming apparatus according to claim 5,wherein, while the equipment is being used with both of the hands andwhile the image printed by the image forming apparatus in the print jobis being displayed, the hardware processor accepts, by the voice, afifth instruction for display of a different image printed by the imageforming apparatus instead of the image or adjustment and display of theimage as the instruction.
 7. The image forming apparatus according toclaim 6, wherein, after completion of preparation for performance of theprocessing while the equipment is being used with both of the hands, thehardware processor accepts, by the voice, a sixth instruction for startof the processing as the instruction.
 8. The image forming apparatusaccording to claim 1, wherein the hardware processor is furtherconfigured to: discriminate whether an operation method of the imageforming apparatus by the voice is to be displayed, based on usagehistory indicating usage of the equipment by the user; and the imageforming apparatus further comprises a display that displays theoperation method in a case where it is discriminated that the operationmethod is to be displayed.
 9. The image forming apparatus according toclaim 1, wherein the hardware processor disables the instruction frombeing accepted by the voice before the use of the equipment with both ofthe hands starts, enables the instruction to be accepted by the voicewhen the use of the equipment with both of the hands starts, anddisables the instruction from being accepted by the voice when the useof the equipment with both of the hands finishes.
 10. An image formingapparatus to be used together with equipment that measures a living bodyof a user holding the equipment with both hands, the image formingapparatus comprising: a voice input unit configured to collect sound andgenerate voice data; a hardware processor configured to turn on and offvoice input processing; wherein the image forming apparatus does notaccept, by voice, an instruction for processing to be performed by theimage forming apparatus before the user holds the equipment the imageforming apparatus accepts, by the voice, the instruction while theequipment is measuring the living body.
 11. An instruction acceptancemethod comprising: disabling, before a user holds equipment to be usedby the user with both hands, an image forming apparatus from accepting,by voice, an instruction for processing to be performed by the imageforming apparatus; and enabling the image forming apparatus to accept,by voice input processing, the instruction in response to the equipmentbeing used with both of the hands.
 12. A non-transitory recording mediumstoring a computer readable program for controlling an image formingapparatus to be used together with equipment to be used by a user withboth of hands, the computer readable program causing the image formingapparatus to perform: disabling an instruction for processing to beperformed by the image forming apparatus, from being accepted by voicebefore the user holds the equipment; and enabling the instruction to beaccepted by voice input processing in response to the equipment beingused with both of the hands.